三類測驗型式

以下摘要撰寫計畫過程中整理的測驗形式(包含linear test、CAT、MST)摘要,並簡述優、缺點。

值得紀錄的是

  1. CAT的優點不只是施測較有效率,同時也可以有較高的測驗準確度。詳細的原因涉及測驗理論,不在此詳述。
  2. MST在書中乍看不出優點,但在與研究伙伴討論後想到幾個可能的用法在此記錄。

Linear test

computerized adaptive test (CAT)

multistage test (MST)

Table : A comparison of linear, CAT, and MST designs (from Magis et al., 2017, p 4)

Linear Test

Advantages Disadvantages
Ease of assembly Full length test
Ease of administration Inefficient for measurement
Least effort for test development (TD) Inflexible test schedule for test takers
Prone to test copying

CAT

Advantages Disadvantages
Shorter test length Complicated to implement
Efficient for measurement Depends on strong model assumptions
Flexible test schedule for test takers Requires a large calibration data set
Avoids test copying Greatest effort for TD
Item exposure more difficult to control
Costly to administer via computer
Robustness concerns

MST

Advantages Disadvantages
Intermediate test length Depends on model assumptions
Efficient for measurement Longer than CAT but shorter than linear test
Allows test taker item review (within modules) Item exposure concerns (similar to CAT)
Easier to implement Costly to administer via computer (similar to CAT)
Easier to assemble
Moderate effort for TD
Flexible test schedule for test takers
Reduces test copying

references

Magis, D., Yan, D., & Von Davier, A. A. (2017). Computerized Adaptive and Multistage Testing with R. Springer International Publishing. https://doi.org/10.1007/978-3-319-69218-0